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student Ratings and Image for an Ideal Professor 

Frances S. O'Tuel - , - 

University of South Carolina 

The influence of expectations on student ratings of their professors 
~was^introdu"ced in a prevTous'ya'peFTO'TueVr 1978)1 TfieTlleWidpTnMtljf an 

1, ^--instrument-to-measure-this. expectancy and the mtings by students of how 

they prtiiceive their professors was descriBed. Test-retest and KR-20. 
reliability coefficients as well as logical and empirical validation of 
the instrument was reported. 

Follo'vdng the pilot studies reported earlier, a large scale study 
was undertaken. The results of this study are the substance of this 

paper. . 

Treffinger and Feldhusen (1970) found that generalized- precourse 
ratings of other courses at ah institution predict student "evaTuations 
. of an instructor at the, end of his/her course. The Dr. Fox effect reported 

by Ware and Williams (1976) Indicated that'students were evaluating the 

J 

' professors enthusiasm rather than other characteristics of instruction. 
Winne (1977) explained inconsistencies in th¥~fTfrdiTrp~bf "nominally 
similar treatments as aptitude treatment interactions. He stated, "for 
example* students' preference for one or another kind of teaching, may influence 
learning and attitudes differently when the. teaching they receive corre- 
! sponds to their preferences or expectation in. ratings of instructors is the 
issue in this study. 
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, Questions asked were: 

1. What items and categories are mos^^ important to students? " 
- " 2. What is the cbrreUtion between student expectancy and the 

ratings of a professor? ,. ' » 

3. Are there differences in these relationships across levels, 
undergraduate and graduate and across suBject areas? 

4. What is the -correlation bet//een the expectancy-reality rela- 
tion and general course satisfaction? 

.. . Method 

Sample 

The sample was composeci of 2784 college students, graduates and under- 
graduates. All students in a College of Education at a state university 
vvere asked to participate. 
Instrument 

The Student Expectancy Evaluation (SEE), a Q-Sort..was used for the 

pre and) post measures.. It contains 16 items (see /appendix A), 4 items: 

. " ■ - ■ . I ■ ..... 

in each subscale. The subscales are' subject expertise^.^ pedagogical exper- 

tise, stimulation, and empathy. Tejt-retest reliability was .73 and .81 on 

previous Dilot samples. Logical Ya]idation 6y experts and empiricarvalida- 

tion by factor analysis were used to establish validity. 

Procedures 



Students were administered the pretest O^nd posttest) by an outside 
examiner who came into each class during one of the first two class meetings 
of^^'the semester. Administration followed standardized procedures. Students 
were instructed to stack the 16 statements about teachers in the order from 
most to least importance for an ideal teacher of the particular coiuirse in 
which" they were enrolled. These were recorded. On next to. the last class 
of the semester the exairiiner returned to the classrooms and instructed 



students to «;t-a ck the cards in order according to how they pferceived their" 
professor to. have been. Various nominal data such as sex, age, course 
required or elected, student parttime or:fulltime and student graduate 
or undergraduate were collected on the pretest. On the posttest these 
spaces were used to assess student satisfaction with the course. Five 
items four of which could be answered" from 1 to 4 being the positive 



evaluative end of the. satis faction" and 1 with a "l o7 2 response were 

inserted, . ■• ' - - — —- ' 

Following the collection, of data analyses were run..,by the Computer 
Center, University of South Carolina using Statistica.l Analysis System 
CSAS), Statistical Packages for the Social Sciences (SPSS) and FORTRAN .programs. 
;The correlations between the pre (ideal) and post (reality) were converted " 
to Fischer Z's, A Speanuan Rho was computed on the Z's and the scores 
on the satisfaction items to estimate- the relationship between students ' 
perceived match on pre and post and their satisfaction with course. 



Results 

On the pretest item with. the lowest Cmost important) rank (3.69) 
was "has competency in and knovfledge about the subject." "Communicates 
ideas clearly" was second, followed By "presents a well organized course" . 
and "is enthusaistic abo'jt the subject and about teaching." For the mean 
. rank of each item as students stacked them to correspond with what. they felt 
. was most to least important for an ideal teacher in that . ss see Table 1. 
The mean rank for the four subscales (categories) placed stimulation' first 
followed by pedagogical expertise, then subject expertise and last empathy. 



Place Table 1. About Here 



On the posttestl^frich was fhe rankTTtudents assigned to how they 

\ 

perceived the professor to have been during the semester, called reality , 
the. most representative characteristic of their professors was "has compe- 
tence in and knowledge about subject." "Is enthusiastic about subject 
and about teaching" was second. "Presents a well organized course", was 

. thi rd ; " rel ates knowl edgelqf __s u.y ect_m^^ to solutions of practical 

problems" ranked fourth followed closely by "communicates ideas clearly" 
(See Table 1). Of the subscales the most representative was subject 
expertise, then pedagogical expertise; stimulation and empathy followed 
in that order. 

The correlations between pre (ideal) and post (reality) were converted 
to Fisher's Z's.. Scores .on the 5 course satisfaction items were then 
correlated with the Z's. Spearman Rho's for these ^are reported by subject 
areas (see Table 2). All are significant at the .0001 level. They range 
from .30 to .50. Although there was differences across classes in the pre- 
' post, correlations, there^ were no-significant differences between, levels or 
between areas. 

PI ace.Ja51_e ...Z^About tfe^ _ .^^^ " " : 



Discussion 

The item which students ranked as most important for an ideal professor 
for the. course was also what they perceived they received, ."knowledge arid 
competence in the subject." "Enthusiasm" was consistent in the pre and post 
as v/as "well organized course," "Communicates ideas clearly" was not quite 
as representative of reality as ideal but an additional characteristic the 
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the students perceived they received in the courses was "reTatmg knowledge 
to solutions of practial problems." 

G ... 

Pedagogical expertise had been ranked first on the ideal and was second 
on the perceived. Subject, expertise was ranked first in perceived but was 
third on the subscales for ideal- Stimulation dropped from second on ideal to 
third on perceived and empathy ran fourth for both ideal and perceived, / 
Spady C1974) proposed that the most important component of a teacher's 
repertory of abilities was the capacity to establish a sense of rapport with 
students by caring aboutth.em as individuals. His position was that the critical 
variable was empathy and concern because as students. mature (level of develop-- 
ment -expectation) teachers' charisma and areas of expertise would erode in 
value. The evidence from this study of college students is contrary to 
Spady's writings. Empathy was a poor fourth in the categories and none of 
the items from that subscale were in the top 5 ranks. 

It would appear that students Want to get the money's worth which 
they interpret as expert knowledge in a well organized course which is 
presented as interestingly as possible, not whether the teacher takes. a 
personal interest in them as an individual. . y 

- Furthenuors, the results indicate that students who think they get what 
they thought they wanted are "satisfied'*, With the course. Where, does that 
leave- student rati ngs of professors? SoiTewhere between pergatory and limbo? 
Students' ratings of professors appear to be little more than their scaling 
of theoprf-^essor against their expectations. If they think they received 
what they wanted, the professor gets a high rating. If it v/as not what 
they expected,' the professor gets a low rating. Unless we can control or 
at least' assess students' expectations, v^e had better be extremely cautious 
.about any decisions based on student evaluations. 

■ • ■-- ■ ■■■ 1 . ^ ■ ■ ' , 



Table 1 



Mean Rank of 16 Items and Category on Pre (Id^al) and Post (Reality) for 

Tbtal Sarr^ple 

Item . Pre 2784 Post 179T " 

1. _______ 4.78 7.82 

(3.18) , (4.34) . _ • 

2. ^ — 9.02. 8.82 

- - - - (4.12) (4.48) ■ 

.3. .— — ., ' 9.72 " " 9.07 

■ -. (4.25) (4.57) . : 

4, _- . 5.78 7.53 

. (4.18) (5.20) 

5. __ 11.47 ° 8.64 



(3.81) (4.18) 

3.69 3.72 

(3.57) (3.69) 

11.18 8.87 
.(4.21) ■■ (4.69) 

7.78 7.57 

(4.153) (4.19) 

7.80 8.56 

(3.69) .■ "'(3.89) 

11.43 10.01 

(4.59) , (4.69) 

11. 10.19 . . 9.21. 

(3.90) (4.29) 

12,. — __ — 10.21 9.71 

~ . . „ (4.38) „ (4.60) . 

t 

13. — -- -- 8.67 "9:87 

, . • . (3.92) (3.83) 

14. 9.25 10.15 

. (3.86) (3.90) 

15. — — 5.93 6.03 

: (4.10) (4.31) 

16. -— — 9;09 t 10.53 

. •. (3.77) (3.59) 

Pedagogical . \ 

Expertise 7.33 • ■ . ^ .. 8.31 , 

C2.16. n ' C2-53I 

O ' ■ . . ' ' ■ ■•' ' ' ' ■ ■ ' ^' 



7. 
8. 
9. 



Item 



Table 1 (Continued) 
PreZTM Post 1791 



Subject , 

Expertise 8.53 7.17 

(2.34) (2.48) 

Eraathy <> 9.91 9.37 

(2.77) (2.95) 

Stirnulation 8.24 ■ . ,1''^^^, 

. (2.33) (2.25) 



Table 2 
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Spearman Rho Correlation Coefficients 
between Pre-Post Correlation (Converted) and the Score on 
Course Satisfaction by Area 



Correlation 
between Pre- 
Post (converted) 
and Satisfaction 



Foundations 

}1 -= 724 
.30^ 



CcKredr Development 

N = 383 
• 35^ . 



Curriculum & 
Instruction . 

*N - 120 . 
.50^ 



note: a = p < .001 
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Appendix A 
Evaluation Items \ . 

. Communicates Ideas Clearly^ ^ ^. 

. Classes are Organized to Allow for Meaningful.lnter^^^^ 

. Evaluates Consistently and in an Unbiased Manner 

. Presents a Well Organised Course ---'^^ 

. Answers Impromptu QuestionsAsked. ' ; 

.0 Has Competence in, and Knowledge About, Subject 

. Identifies Basic "Truths" of Subject Area ; 

. Relates Knowledge of Subject 'Matter to Solution of f^ractical Problems 

. Is Interested in Whether Each Student Understands the. Material " 

. Is Someone with Whom a Student Can' Identify and Relate 

. Appreciates. Each Student's Efforts 

Is Sensitive to the; Personal Needs of Each Student > 
Stimulates Students Intellectually 

Elites Students to Think for Themselves About Problem and Issues 
IsNEnthusiastic about the Subject and About Teaching 
. Mot-j^^ates Students to Do Their Best 



